🕷️️ Job Radar • SCRAPING

upwork.com 🟢 2026-05-14

🔹 Technical Manifest for Medical Provider Data Mining & Web Scraping
👤 Client: 🇺🇸 United States Member since 2021-03-11
💰 Price: ****
🚩 Problem: Organize and structure raw medical provider data from New York into a clean database.
📦 Existing: Not specified

Specifications:

[Target] - Build an organized database of medical providers in New York with detailed information.
[Method] - Use web scraping techniques to collect data from public and professional sources.
[UI/UX] - Not applicable (data-driven project).
[Stack] - Python (BeautifulSoup, Scrapy), Pandas for data processing, Google Sheets or Excel for storage.
[Security] - Ensure compliance with HIPAA regulations. Use secure web scraping practices to avoid legal issues.
[Format] - Deliver a clean and organized spreadsheet with minimal duplicates.

Workflow:

1. Define the list of specialties required by the client.
2. Identify reliable public and professional sources for medical provider data.
3. Develop web scraping scripts using Python to extract relevant information.
4. Clean and organize scraped data using Pandas.
5. Remove duplicates and ensure accuracy.
6. Export cleaned data into a clean Excel or Google Sheet format.